A Knowledge - based System Integrating Speech and Image Understanding – Manual Version 1 . 0 –
نویسندگان
چکیده
We present a system that integrates speech and image understanding in the domain of a construction task. Knowledge needed to interpret speech and images is stored in one homogeneous knowledge base using the semantic network formalism ERNEST. It provides a means for constraint propagation and therefore – using a uniform representation of the information gained from real input data – the speech and image understanding processes can profit from each other. Even preliminary results are used to restrict the number of valid interpretations. Examples illustrate the flexibility and the performance of our integrated system.
منابع مشابه
Integrating Fuzzy Inference System, Image Processing and Quality Control to Detect Defects and Classify Quality Level of Copper Rods
Human-based quality control reduces the accuracy of this process. Also, the speed of decision making in some industries is very important. For removing these limitations in human-based quality control, in this paper, the design of an expert system for automatic and intelligent quality control is investigated. In fact, using an intelligent system, the accuracy in quality control is increased. It...
متن کاملThe 16th Meeting on Image Recognition and Understanding Object Recognition by Integrated Information Using Speech and Web Images
It is an important task for a robot to bring objects requested by human via voice. In order to achieve the task, object recognition using speech and images is needed. Ozasa et al. [1] has proposed the method for object recognition by integrating speech and image features. Although this method requires both speech (word) and image models, the speech models are automatically constructed by combin...
متن کاملClassification of emotional speech using spectral pattern features
Speech Emotion Recognition (SER) is a new and challenging research area with a wide range of applications in man-machine interactions. The aim of a SER system is to recognize human emotion by analyzing the acoustics of speech sound. In this study, we propose Spectral Pattern features (SPs) and Harmonic Energy features (HEs) for emotion recognition. These features extracted from the spectrogram ...
متن کاملNeural Network Based Recognition System Integrating Feature Extraction and Classification for English Handwritten
Handwriting recognition has been one of the active and challenging research areas in the field of image processing and pattern recognition. It has numerous applications that includes, reading aid for blind, bank cheques and conversion of any hand written document into structural text form. Neural Network (NN) with its inherent learning ability offers promising solutions for handwritten characte...
متن کاملIntegrating behavioral and social sciences components into a competency-based MD program curriculum: A qualitative study on opinions of faculty members
Background: Behavioral, social, psychological and biological factors influence health and disease; and, to achieve professional competency, physicians should be knowledgeable about their society and its inhabitants’ behavior. This knowledge will help physicians to become competent in communication, professional behavior, self-awareness, ethical reasoning, and understanding cultural and ...
متن کامل